(19) 



J 



(12) 



Miiiuiiiiiiniiiiiiii 



(43) Date of publication: 

07.01.1998 Bulletin 1998/02 



EuropdJsches Paterrtamt 
European Patent Off tee 
Office europSen des brevets (11) EP0817 501 A2 

EUROPEAN PATENT APPLICATION 

(51) Int. CI. 6 : H04N7/50 



(21) Application number: 97111058.0 

(22) Date of filing: 02.07.1997 



(84) 


Designated Contracting States: 


(72) 


Inventors: 




AT BE CH DE DK ES Fl FR GB GR IE IT LI LU MC 




Khor, Chee Slong 




NLPTSE 




No 07-52 Singapore 520461 (SG) 


(30) 




• 


Tan, Thiow Keng 


Priority: 04.07.1996 JP 175092/96 




No. 03-5064 Singapore 470601 (SG) 


(71) 


Applicant: 


(74) 


Representative: 




MATSUSHITA ELECTRIC INDUSTRIAL CO., LTD. 




Grunecker, KInkeldey, 




Kadoma-shl, Osaka 571 (JP) 




Stockmalr & Schwanhausser 








Anwaltssozletat 








Maximilianstrasse 58 








80538 MOnchen (DE) 



(54) Management of multiple buffers and video decoders in progressive digital video decoder 
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(57) A progressive (non-interlaced) video decoding 
system has : memory for input transmission buffering a 
video brtstream received from a transmission channel: 
transferring device . coupled to said input transmission 
buffering means, for multiplexing and transferring the 
said video brtstream to the multiple video decoders; 
controller, coupled to said means for multiplexing and 
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transferring, for controlling the decoding process of 
each of the multiple video decoders; and demultiplexer , 
coupled to said means for controlling the decoding, for 
controlling the display buffers of each of the multiple 
video decoders and de-multiplexing the display output 
of each of the said display buffers. 
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Description 

BACKGORUND OF THE INVENTION 

5 1 . Field of the Invention 

The present invention relates to a compressed video decoding apparatus which is capable of decoding video bit- 
stream containing progressive (non-interlaced) pictures which is different from the existing interlace pictures in televi- 
sion system. 

to 

2. Related art of the Invention 

The current existing television systems in the world are NTSC, PAL and SEC AM. All this systems are interlace dis- 
play systems which can be annoying at times and also weakens the human eyes. Some manufacturers had tried to 

is resolve this by using double line scan. In double ine scan, each line of the picture is scan twice to produce a fficker free 
output. However, this only solves half the problem. This is because the artifacts such as 'steps* appear at the edge of 
pictures, giving the appearance that the picture is blocky During the last few years, there had been attempts by some 
broadcasters and manufacturers to rectify ttese problems by proposing a new television standard called ihe High Def- 
inition Television Standard (HDTV). However, high costs and complexity in both the receiver and broadcasting equip- 

20 ment discourage most consumers and broadcasters. As a result wide acceptance in the real world had not been very 
successful. 

Recently, the Moving Pictures Expert Group (MPEG) had defined a new video compression called the MPEG2 
which is capable of compressing pictures upto 200 times and therefore open the path for digital broadcasting. However, 
MPEG2 video compression chips that were delivered as a result of this standard mostly use only Main Prof ile at Main 

26 Level (MP@ML) and display the standard interlace output This therefore does not completely solve the problems men- 
tion above as there is no improvement in either picture resolution nor display rate. 

Current existing standard systems can only display interlace output This type of flickering display can be rather 
annoying to users and damaging to the eyes. In addition the resolution is low and interfacing to computer graphics 
which is generally of high resolutions is unsatisfactory. Current analog transmission system is also lower in cpjaJ'rty and 

$o reliability compared with digital transmission. However, digital transmission bandwidth requirement is enormous and 
some compression is required. HDTV systems which can solve most of the above problems cost too high both for 
broadcasters and consumers. 

SUMMARY OF THE INVENTION 

55 

A system had been invented which is capable of decoding progressive video brtstream compressed according to 
the MPEG2 standard. The system is capable of displaying progressive pictures fficker free and with little artifacts. The 
system also provide a higher resolution compared to existing standard system. In addition, interfacing to and displaying 
computer graphics is easier and results in higher quality output More importantly, it is expected to cost much less than 

40 a HDTV system, both for broadcasters and consumers. 

That is a system had been invented which is capable of decoding progressive video brtstream compressed accord- 
ing to the a MPEG2 standard. The system is capable of displaying at a progressive output of 60 Hz for NTSC system 
with a resolution of 720X480 per frame of picture. With the number of horizontal scanning lines increased per vertical 
scan, the pictures appear sharper than interlace. More importantly, the pictures are now flicker free with no drop in pic- 

45 ture quafity. In addition, interfacing to computer images and graphics can be done more easily as most computer 
images are non-interlaced and those annoying single fine flicker is removed. 

Esti mated cost of the progressive decoding system is about only 10-15% of the current high end television system. 
Broadcasting equipment for a progressive decoding system is also expected to only cost about 10*15% more than cur- 
rent broadcasting equipment This is significantly lower than HDTV which curentty can easily cost twice as much more 

60 for either receiver or transmitter. 

For the purpose of solving the above-described problems, a progressive video MPEG2 decoder according to the 
present invention comprises means for input transmission buffering a video brtstream to the multiple video decoders, 
means for controliing the decoding process of each of the multiple video decoders and means for controffng the display 
buffers of each of the multiple video decoders and de-muttiplexirig the cSsplay output of each of the said display buffers. 

66 By the above described configuration, the present invention is a system that is capable of receiving MPEG2 com- 
pressed progressive video brtstream from a transmission channel, decoding and reconstructing the pictures from the 
said video brtstream, transferring the reconstructed pictures into display buffers and f inaly output the display buffers pic- 
tures into a progressive monitor. The present Invention can be used either as a broadcast decoder receiver or as the 
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decoder in a disc system. 

BRIEF DESCRIPTION OF THE DRAWINGS 

5 Figure 1 is a block diagram of a novel buffers and interlace video decoder management scheme in one embocSment 
according to the present invention, 

Figure 2 is a block diagram showing one example of the internal arrangement of the decoding units in Figure 1 , 
Figure 3 illustrates the picture type and display order in typical sequence of display, 

Figure 4 illustrates the picture type and display order in a encoded video bHstream corresponding to the display 
10 order shewn in Figure 3. and 

Figure 5 shows the flow diagram of the rrticro-controll er processes in the management scheme of buffers and inter- 
lace video decoders for a progressive video decoder system in one embodiment according to the present invention. 

PREFERRED EMBODIMENTS 

15 

With reference to the drawings, a brief explanation on MPEG2 syntax and bitstream wffl be explained hereinafter. 
The MPEQ2 bitstream has video syntax which corresponds to a hierarchical structure. A "sequence" is the top layer of 
the video coding hierarchy and consists of a header and some X>oup Of Pictures" (OOPS). Trie sequence header ini- 
tializes a decoder. A OOP consists of a header and a number of pictures. Each OOP usually has one i-pictures, some 

20 B-pictures and some P-ptcture. The i-picture , B-picture and p-picture also have header codes indicating picture type. I- 
pictures are intra-coded, La. they are compressed using only information from within the picture itself. P -pictures are 
coded from a previous P-picture or 1-picture and from within the picture itself. B-pictures are bicfirectionally -coded pic- 
tures, which means that B-pictures are coded from previous l-picture or P-picture and from the future P-picture. 
Because of picture dependencies, the pictures in the compressed video bitstream is not in display order. For example, 

25 as shown in Figure 3 is the normal display order of a group of pictures. Comparing this with the picture order as shewn 
in a video bitstream in Figure 4, it is shown that the B-pictures is dependent on l-picture or P-picture and therefore 1- 
picture and P-picture must be transmitted and decoded before the B-picture. 

The operation of each of the decoding unit 3,4,5 as shown in Figure 1 and Figure 2 will be explained hereinafter. 
Each decoding unit 3.4.5 requires one OOP of pictures plus the first four pictures from the next OOP. The reason is due 

30 to the fact that each of the decoding unit operate in a pipeine manner but independent of each other, lb further explain 
the reason, observe what had been explained earlier in the video syntax of MPEG, where l-picture and P-picture must 
always precede the B-pictura However, in the normal GOP other than the first GOP of a sequence, the picture order in 
the bitstream is usually in the order below. 

35 Previous OOP current OOP next OOP 

T HPPP PPPPP - T HRpp«PM P .IBBPHBPBHP 

40 

Hence the first two B frames of the current GOP to be decoded by the decoder unit example, 4. must be removed. 
However, this cause a loss of two frames which is unaoceptabia lb rectify this, the decoder unit 3 that decodes the 
GOP preceding the current GOP wM decode the IBBP pictures of the current GOP white decoding unit 4 will decode 

45 the IBBP of the next GOP. Therefore, no pictures are lost and each decoding unit 3,4,5 remains independent 

With reference to the drawings in Figure 1 and Figure 2, an embodiment of the management of the buffers and 
video decoders will be explained hereinafter. Whenever an input video bitstream is received from a transmission chan- 
nel, the transmission buffer 1 wil buffer the bitstream until the header detection unit 2 is ready to process the bitstream. 
The header detection reads the bitstream from the transmission buffer 1 at a rate that is much faster than the input rate 

so into the transmission buffer 1. This ensures that the transmission buffer win not overflow. The header detection 2 has a 
comparator to compare the input bitstream with the required header to be detected, which is provided by the micro-oon- 
troBer 6. The micro-controler 6 controls the header detection 2 by loading the header code to be detected into the com- 
parator. By loading the header code to be detected, the micro-controller 6 can detect the start and end of a GOP and 
also the picture type in the video bitstream coming from the transmission channel. Therefore, the mkyo-controler 6 is 

66 able to cut up the bitstream into three portions as shown in Figure 1 and controls multiplexer 2 which multiplexes and 
feeds the video bitstream into the independent decoder units 3,4,5 as shown. 

Figure 2 shows the internal block diagram of the decoding units 3,4,5. When decoding units 3,4,5 receives the mul- 
tiplexed video bitstream from the multiplexer 2, the bitstream is stored in the multiplexed buffer 13 of each of the decod- 
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ing units 3.4,5 as shown in Figure 2. The decoding units 3.4,5 then wait for the start signal from the micro-controller 6 
to activate the interlace video decoder 14 and hence the decoding process. The micro-controller 6 activates the inter- 
lace video decoder 14 when the multiplexed buffer 13 has enough bitstream data for the decoding process. During the 
decoding process, the interlace video decoder 14 reads the bitstream from the multiplexed buffer and outputs the recon- 

5 structed pictures into the respective display buffer 7,8,9 connecting independently to each of the decoding units 3.4.5. 
the interlace video decoder 14 stops decoding when the multiplexed buffer 13 is almost empty. Usually this also indi- 
cates that one OOP of bitstream has been read out from the multiplexed buffer 13 and had been decoded by the inter- 
lace video decoder 1 4. Once the interlace video decoder 1 4 stops decoding, it can be activated again only by the micro- 
controller 6. Therefore the micro-controller 6 can control the decoding period and sequence of the decoding units 4,5.6 

w in a pipefine manner and thus ensure that the input bitstream is decoded in syrKhronization with the bit rate, i.e., no 
underflow or overflow will occur. 

The micro-controller 6 controls the output of the display buffers 7,8,9. At anytime, only one of the display buffers 
7,8,9 wH be selected lor reconstructed picture output to be sent to the de-multiplex unit 10. The display buffers 7,8,9 
wil be rotational selected by the micro-controller 6 to ensure a seamless output at the display monitor 1 2. The post filter 

ts 11 interpolates the chrominance video data to generate a 720X480 display output. Because of the post filtering, some 
buffering at the post filter 1 1 is required to delay for the luminance reconstructed video data. The reconstructed and post 
filtered picture data is then synchronized with the video sync and finally converted to analog tor display on the display 
monitor 12. 

Figure 5 shows the flow diagram of the micro-controller 6 processes in the management scheme of buffers and 
20 interlace video decoders for a progressive video decoder system. Starting from typical process flow in the micro-con- 
troller 6 at 15, where the header detection unit 2 checks for the GOP header. For simplification purpose and prevent 
repetitive drawings, the typical decoding unit is labeled as X. 

this is because the micro-controller 6 wil rotate the controls through all the decoding units 3,4,5 and the opera- 
tions are the same. Once the OOP header is detected, the decoding unit(X-1) which had bitstream written to it previ- 
ze ousty is activated(step 1 6). At the same time, as in step 1 7 the decoding unit (X) which has just completed decocSng will 
have its multiplexed buffer 13 enable for bitstream input. Also, as in step 18, display buffer connected to decoding unit 
(X) is enable and the data read out to the de-mutipf exer 1 0. The control process then repeat itself but the decoding unit 
affected is (X) as in step 20. and (X+1) as in steps 21 and 22. 

As mentioned above the present invention for a progressive video decoder enables multiple interlace video decod- 
so ers to run in a pipeline manner to achieve the bandwidth and timing required to decode progressive video bitstream 
received from a transmission enamel and display as a norvinteriace fScker free video output Input video bitstream upto 
100M bitsfe can be received by this buffering and control management technique. The GOP headers in the received 
video bitstream is tagged and the subsequent bitstream following the GOP headers is then multiplexed to the interlace 
video decoders which are running in a pipeline manner. Picture decoding, reconstructing, and display operations are 
ss synchronized to permit the transfer of data from the input buffer to the interlace video decoders and from the interlace 
video decoders to the display buffers seamlessly, and without causing either underflow or overt lew problems in any of 
the interlace video decoders. A micro-controller regulates and controls the operation of data transfers, intensive and 
high speed processing, video decoders activity and synchronizing in the progressive decoder system. As apparent from 
the above described explanation, by a novel management of buffers and interface video decoders, a MPEG2 video 
40 decoding receiver, that can decode at more than twice processing power than that of a normal interlace MPEG2 
decoder and therefore capable of decocfing progressive video bitstream and displaying on a progressive video monitor 
is invented. 

Claims 

46 

1 . A progressive (non-interlaced) video decoding system comprising: 

buffering means for input transmission buffering a video bitstream received from a transmission channel; 
transferring means, coupled to said input transmission buffering means, for multiplexing and transferring the 
so said video bitstream to the multiple video decoders; 

controlling means, coupled to said means tor multiplexing and transferring, tor controlling the decoding process 
of each of the multiple video decoders; and 

de-multiplexing means, coupled to said means for controlling the decoding, for controlling the display buffers of 
each of the multiple video decoders and de-multiplexing the display output of each of the said display buffers. 

66 

2. A progressive video decoding system as defined in claim 1 wherein said means tor multiplexing and transferring 
data includes means tor identifying coded headers data in the video bitstream and determining the video decoders 
in which the bitstream is to be transferred to. 



4 



EPO 817501 A2 



3. A progressive video decoding system as defined in claim 1 wherein said means lor multiplexing and transferring 
data includes means for storing the said multiplexed bitstream into input multiplex buffers that are coupled to each 
of the said video decoders 

5 4, A progressive video decoding system as defined in claim 3 wherein said bitstream storing includes means for 
determining when a said bitstream containing a group of pictures had been received. 

5. A progressive video decoding system as defined in claim 2 and 3 wherein said determining includes a micro-con- 
troller. 

10 

6. A progressive video decoding system as defined in claim 1 wherein controlling the decoding process includes 
decoding means for reconstructing pictures by each of the said multiple video decoders. 

7. A progressive video decoding system as defined in claim 1 wherein controlling the decoding process includes 
is determining means for the starting and stopping the decoding process of each of the said multiple video decoders. 

8. A progressive video decoding system as defined in claim 1 wherein controlling the display buffers of each of the 
said multiple video decoders includes means for tra n sferring reconstructed pictures by the said multiple decoders 
to the cfl splay buffers and storing the reconstructed pictures into the display buffers. 

20 

9. A progressive video decoding system as defined in claim 1 wherein de-muftpiexing the cfisplay output includes 
means for display control ling of each of the said multiple video decoders cfisplay buffers. 

10. A progressive video decoding system as defined in claim 9 wherein display controlling includes means for deter - 
25 mining the start and stop of storing process into the display buffer and the start and stop process of transferring to 

the display output device. 

11. A process of pipeline decoding a video bitstream comprising steps of: 

30 receiving a video bitstream by each of the said multiple video decoders into the said input multiplexed buffers; 

pipeline decocfing by each of the said multiple video decoders using the bitstream data from the said input mul- 
tiplexed buffers; 

35 reconstruction of pictures by each of the said multiple video decoders and storing the said reconstructed pic- 

tures into the cfsplay buffers coupled to each of the said multiple video decoders; and 

controlling the transfer of reconstructed pictures from the display buffers to the dteplay output 

40 
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Enable bitstream write 

Decoding unit(X). 
Disable write for others. 
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Enable bitstream write to' 

Decoding unit(X+1). 
Disable write for others. 
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